Method for processing digital images

ABSTRACT

A portable image capture device, program and method for controlling and managing data captured thereby. A device program residing on the portable image capture device generally associates data processing attributes with image files generated for image data captured by the portable image capture device. In some embodiments, the device program associates data processing attributes related to prompts for pre-defined image data with corresponding image files generated in response to the prompts. The device program, and attribute and prompt data therefor are created on a data processing system and are transferrable therefrom to the portable image capture device.

PRIORITY

This application is a Continuation application of U.S. patentapplication Ser. No. 09/250,581, filed Feb. 19, 1999 by inventor RobertW. Schuetzle.

BACKGROUND OF THE INVENTION

The invention relates generally to portable image capture devices, andmore particularly to controlling and managing data captured by portableimage capture devices, computer programs and methods therefor.

Digital still cameras and digital video recorders are known generally,and have revolutionized the acquisition, storage, display, processingand distribution of image data. These devices capture still or movingimage data focused onto a light detector, for example a charge-coupleddevice, and generate corresponding digital image files, which are storedon a data storage medium thereof. The image files are generally viewableas images on a display of the device and are transferrable to a computerfor subsequent storage, display, processing and distribution.

The KODAK DIGITAL SCIENCE DC260 digital still camera, for example,generates and stores digital image files corresponding to image datacaptured thereby in a removable memory storage device thereof known as aflash memory card.

The image files may be viewed on a liquid crystal display of the camera,and may be transferred to other cameras and to data processing systemsby an RS-232 or USB serial cable, or by an infrared transceiver, or byremoving the flash memory card and inserting it into a compatible memorycard adapter on another device or system.

Many portable image capture devices operate on a programmable softwareoperating system that may also run application programs. In the past,these operating systems were largely proprietary, but more recentlythere has been a trend toward standardized, non-proprietary operatingsystems in portable image capture devices. The KODAK DC260 camera, forexample, operates on an industry standard DIGITA operating system, whichis programmable to control various camera settings like imageresolution, and to select different modes of camera operation, forexample capture or review or connect modes. The DIGITA operating systemand other standard operating systems may also be used on other portablestill or moving image capture devices, including digital video capturedevices.

The KODAK DC260 camera also executes application programs, and moreparticularly DIGITA-compatible script files downloaded onto the camera.The script files also may be used to configure camera settings, and toprompt the user, via visual display prompts, to perform certain actions,for example to capture pre-specified image data. The FLASHPOINT DIGITAScript Guide, Digita Operating Environment Version 1.0, dated 17 Jun.1998, for example, discloses an exemplary script entitled “GuidedCapture” executable on the KODAK DC260 camera that displays visualprompts for the capture of a sequence of pre-specified pictures.

The DIGITA-compatible script files executable on the KODAK DC260 cameraare created by a DIGITA script development program or a text editorprogram on a general purpose computer and then down-loaded or otherwisetransferred to the digital camera by the serial cable or transceiver orflash memory card, as discussed generally above. See also, InternationalPublication No. WO 97/30375, published 21 Aug. 1997, entitled “Methodand Apparatus for Configuring a Camera Through External Means”, whichdiscloses generally the transfer of application programs and data baseinformation from a computer to digital and film based cameras forconfiguring the operating system and operational parameters thereof andfor identifying image data captured thereby.

It is known generally to add watermark or label information, includingtime and date information, to image data captured by still and videocameras. This information is generally overlaid on the image or on aperimeter thereabout for viewing with the image. The KODAK DC260 camera,for example, includes a watermark feature that permits the addition oftime, date, logos and user defined textual information to imagescaptured thereby. In the KODAK DC260 camera, the watermark data isstored as part of the corresponding image data file and is integrated,or associated, therewith during image capture for viewing with theimage. When the watermark feature is enabled on the KODAK DC260 camera,the selected watermark is associated with each image captured, until thewatermark feature is disabled. The selected watermark must also bechanged prior to capturing each image if a different watermark isdesired for different images, for example to provide descriptive textthat uniquely identifies each image.

It is also known generally to store audio data in association with imagedata captured by portable image capture devices. This feature isinherent in most video devices. In the KODAK DC260 camera, sound clipsmay be recorded after the image data is captured, and then attached tothe corresponding image file after the image file is stored in memory.See also, International Publication No. WO 98/17059, published 23 Apr.1998, entitled “A Method and System For Adding Sound To Image In ADigital Camera”.

Digital image data files have standardized formats and permit savingnon-image data in user definable attribute storage portions thereof, asis known generally. Still images image file formats include for examplethe EXIF, SPIFF, TIFF and JPEG formats, and video image file formatsinclude for example the MPEG format. Thus user defined non-image dataand other data related to image files may be saved in portions of theimage file specifically designated therefor.

International Publication No. WO 97/26757 published 24 Jul. 1997entitled “Electronic Digital Camera with Image Identification”,International Publication No. WO 98/30375, published 21 Aug. 1997,entitled “Method and Apparatus for Configuring a Camera Through ExternalMeans”, and International Publication No. WO 98/18258, published 30 Apr.1998, entitled “System and Method for Correlating Processing Data andImage Data Within A Digital Camera Device”, among others, disclosegenerally the storage of user defined image identification data inassociation with images captured by digital and film base cameras.

International Publication No. WO 97/30375 entitled “Method and Apparatusfor Configuring a Camera Through External Means” discloses identifyingimage data stored on the camera with data base information transferredthereto from a computer, as discussed generally above.

The present invention is drawn toward advancements in the art ofportable image capture devices, computer programs and methods therefor,and combinations thereof.

An object of the invention is to provide novel portable image capturedevices, computer programs and methods therefor, and combinationsthereof that overcome problems in the art.

Another object of the invention is to provide novel computer programsand methods for controlling the capture and management of image data inportable image capture devices, and combinations thereof.

Another object of the invention is to provide novel portable imagecapture devices, computer programs and methods therefor, andcombinations thereof for improving the processing of image data capturedthereby and especially upon transfer of the captured data to a dataprocessing system.

A further object of the invention is to provide novel device computerprograms for portable image capture devices and methods therefor forassociating data processing attributes with image files generated forimage data captured by the portable image capture device.

A further object of the invention is to provide novel device computerprograms for portable image capture devices and methods therefor thatallow an operator of the device to selectively associate data processingattributes with image files generated for image data captured by theportable image capture device.

A further object of the invention is to provide novel device computerprograms for portable image capture devices and methods therefor thatautomatically associate data processing attributes with image filesgenerated for image data captured by the portable image capture device.

Another object of the invention is to provide novel device computerprograms for portable image capture devices and methods therefor forassociating data processing attributes related to prompts forpre-defined image data with corresponding image files generated inresponse to the prompts.

Still another object of the invention is to provide novel systemcomputer programs and methods therefor for generating device programstransferrable to portable image capture devices.

Yet another object of the invention is to provide novel system computerprograms and methods therefor for generating data processing attributedata and prompt data transferrable to portable image capture devices.

These and other objects, aspects, features and advantages of the presentinvention will become more fully apparent upon careful consideration ofthe following Detailed Description of the Invention and the accompanyingDrawings, which may be disproportionate for ease of understanding,wherein like structure and steps are referenced generally bycorresponding numerals and indicators.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a diagrammatic view of a system for controlling and managingimage data captured by portable image capture devices.

FIG. 2 a is a process flow diagram for selecting and associating a dataprocessing attribute with an image file.

FIG. 2 b is an alternate process flow diagram for selecting andassociating a data processing attribute with an image file.

FIG. 3 illustrates one means for associating a data processing attributewith an image file.

FIG. 4 illustrates another means for associating a data processingattribute with an image file.

FIG. 5 illustrates still another means for associating a data processingattribute with an image file.

FIG. 6 a is a process flow diagram for associating a data processingattribute with an image file.

FIG. 6 b is an alternative process flow diagram for associating a dataprocessing attribute with an image file.

FIG. 7 a is a process flow diagram for prompting for the capture ofpre-defined image data on a portable image capture device.

FIG. 7 b is an alternative process flow diagram for prompting for thecapture of pre-defined image data on a portable image capture device.

FIG. 8 is a system and process flow diagram for controlling and managingimage data captured by portable image capture devices.

DETAILED DESCRIPTION OF THE INVENTION

FIG. 1 is a diagrammatic view of a system 10 including a data processingsystem 20, for example a computer system or a network of computersystems, for controlling and managing data captured by a portable imagecapture device 30.

Information is communicated between the data processing system 20 andthe portable image capture device 30 by one or more of any knowncommunication means. Communication may be by wireless signaltransmission, for example in the infrared or radio signal frequencyranges, and/or by signal transmission through a tethered connection, forexample parallel or serial cables, and/or by transferring data stored ona removable media card, for example a magnetic data storage diskette ora non-magnetic data storage card like a flash memory card, as is knowngenerally.

The portable image capture device 30 is preferably a digital imagecapture device, for example a digital still camera or a digital videorecorder or a digital infrared or ultraviolet or some other imagingdevice. FIG. 1 illustrates the device 30 comprising generally a datainput device 32 for detecting or accepting data input, for example alight detector for capturing image data. In some embodiments, the device30 is also capable of detecting audio and/or textual data input forcapture with the image data and/or for storage in association with theimage data. The data input device 32 is thus representative generally ofone or more data input devices for detecting or accommodating differenttypes of input data, including image data, audio data, textual data, andother types of data.

FIG. 1 also illustrates the portable image capture device 30 comprisinga data storage medium 34 for storing image files corresponding to imagedata captured thereby, and for storing data files. The device 30 mayalso include a removable data storage medium 35 in place of, or incombination with, the data storage medium 34.

The device 30 also includes an indicator 36, for example a visualdisplay, to facilitate the capture of images and for viewing imagefiles. The indicator 36 may also signal the operator of the device 30 toperform certain tasks, and may be used by the operator to assign dataprocessing attributes to image files, as discussed further below. Thedevice 30 includes hardware and/or software controlled processing means38 for controlling operation thereof and for generating image filescorresponding to image data detected or captured by the device 30. Thedevice 30 also has means for communicating with the data processingsystem 20, as discussed above.

In an exemplary application, the portable image capture device 30 is aKODAK DIGITAL SCIENCE DC260 digital camera, which is widely availablecommercially from authorized retailers for the Eastman Kodak Company.The KODAK DC260 and other digital camera and digital video recordersinclude generally an image detecting device coupled to a processor thatgenerates digital image files corresponding to image data captured bythe camera, as discussed generally above. The KODAK DC260 cameraincludes a removable flash memory card for storing data and image filesgenerated for images captured thereby, and an LCD display for displayingimages and menu based information. The KODAK DC260 camera also includesan audio input device for inputting audio data and a keypad shuttlefeature for inputting textual data, both of which are storable on thedata storage medium in association with the image file.

The portable image capture device 30 preferably includes a softwareprogrammable operating system for the control thereof and for executingapplication programs stored on the memory storage device thereof, as isknown generally. The KODAK DC260 camera of the exemplary embodiment forexample operates on the industry standard DIGITA operating system, andis programmable to control various camera settings like imageresolution, and to select different modes of operation, for examplecapture or review or connect modes. The KODAK DC260 camera also executesapplication programs, and more particularly DIGITA-compatible scriptfiles downloaded onto the camera by the removable flash memory card orby a USB or RS-232 serial cable or by infrared wireless communications.

According to the invention, generally, a device program is stored in aprogram storage memory of the portable image capture device. The deviceprogram includes an attribute program segment that provides one or moredata processing attributes associatable with an image file generated forimage data captured by the portable image capture device. The deviceprogram also includes an association program segment that associates oneor more data processing attributes provided by the attribute programsegment with an image file generated for image data captured by theportable image capture device. The device program may be a selfexecutable file or may be another program including among others a file,or library, or driver, or other program, and in one embodiment is aDIGITA-compatible script file.

The data processing attributes associated with the image files are usedsubsequently and ultimately for processing the image files, usually upontransfer of image files and the data processing attributes to the dataprocessing system or network. Some processing may also occur on theportable image capture device. The processing of the image files mayinclude routing, sorting, storing, renaming and other general dataprocessing operations. Additionally, the processing of the image filesmay include image file processing procedures more conventionallyassociated with image files, including image cropping, and the controlof contrast, resolution and other parameters.

The data processing attributes are generally pre-defined in a templateor list or data base or document or other file stored on the datastorage medium of the portable image capture device. The data processingattributes are provided, by the association program segment, forassociation with an image file in response to selection oridentification of the attribute by the device operator or by the deviceprogram. In the process flow diagram of FIG. 2 a, selection occursbefore the capture of image data, and in the process flow diagram ofFIG. 2 b selection occurs after the capture of image data.

In one embodiment, the device program includes a select program segmentthat allows an operator of the device 30 to select a data processingattribute to be associated with an image file from a template or list ofselectable attributes, which is displayed on a visual display of thedevice 30. In another embodiment, the data processing attributes areselected by the device program automatically and without input by theoperator as discussed further below. In still other embodiments, someattributes are selected for association with an image file by theoperator either before or after image capture, and other attributes areselected automatically by the device program so that the image file hasmultiple attributes associated therewith.

In one embodiment, illustrated in FIG. 3, the association programsegment of the device program associates the data processing attributewith the image file by writing a data processing attribute to anattribute storage portion of an image file. Many standard image datafile formats, examples of which are discussed above, include userdefinable attribute storage portions, which may be used for thispurpose.

In an alternative embodiment, illustrated in FIG. 4, the associationprogram segment of the device program associates the data processingattribute with the image file by generating a separate association filerelating the data processing attribute and the image file. Theassociation file, for example, may associate the data processingattribute, for example ATTRIBUTE001, with the file name of the imagefile, for example IMAGEFILE.JPG, or some other unique image fileinformation. Other association files may include a data base file or adocument file or other data file that associates or relates the dataprocessing attribute and image file information.

In yet another alternative embodiment, illustrated in FIG. 5, theassociation program segment of the device program associates the dataprocessing attribute with the image file by writing the image file to adocument file stored on the portable image capture device based on thedata processing attribute provided by the attribute program segment. Thedata processing attribute for example may include an address orinstruction, or invoke a function or subroutine that causes the imagefile associated therewith to be written to a document file, andpreferably to one or more specific locations or addresses in thedocument file. In some embodiments, the image file is first stored onthe data storage medium of the device and then written therefrom to thedocument file. And in another embodiment, image file is written directlyto the document file without first creating and storing a distinct imagefile on the data storage medium. The document file for example may be atext file or an Extensible Markup Language (XML) file or some otherdocument file. Generally, multiple image files may be written to andthus integrated with one or more document files.

A data processing attribute may generally be associated with an imagefile during or after image capture. In the present specification and theclaims thereof, image capture is defined to occur during a periodbetween the initialization of capture, for example the actuation of ashutter button on the device, and the storage of an image file generatedfor the image data captured. In FIG. 6 a, the attribute is associatedwith the image file during image capture, and in FIG. 6 b, associationoccurs after the image file is captured, that is after generation andstorage of the image file.

In embodiments where the data processing attribute is associated withthe image file after image capture, it may be necessary to obtain orretrieve some information about the image file. In embodiments where thedata processing attribute is written to an attribute storage portion ofthe image file, for example, it may be necessary to retrieve the memorystorage address of the stored image file. In applications where aseparate association file is generated, it may be necessary to retrievethe name or storage address or some other information about the storedimage file for inclusion in the association file. Similar name orstorage address or other information about the image file may berequired in applications where the image file is written to one or moredocument files.

Associating the data processing attribute with the corresponding imagefile during image capture generally requires less time than if the imagefile is first captured since it is not necessary to wait for the imagefile to be stored prior to association of the attribute. Associating theattribute with the image file during capture also eliminates therequirement for information retrieval in HG. 6 b. Reducing theassociation processing time period may be significant, for example instill camera applications where it is desirable to capture a series ofimages over short time interval. Reducing association processing timepermits capturing images at a faster rate.

The image files and the data processing attributes associated therewith,including any association files and document files, are stored generallyon one or both of the data storage mediums 34 and 35 of the device 30for subsequent transfer to a data processing system 20. Alternatively,the image files and attributes associated therewith, including anyassociation files and document files, may be communicated directly tothe data processing device 20 upon or during association with theattributes. In this latter mode of operation, the image files andattributes associated therewith are generally stored temporarily orbuffered prior to and during transfer to the data processing system 20.

According to another embodiment of the invention, the device programincludes a request program segment that signals one or more prompts tocapture pre-defined image data with the portable image capture device30. In the exemplary KODAK DC260 camera application, the prompts aredisplayed visually an LCD display thereof for interpretation by anoperator. In response to each prompt, the operator initializes thecapture of image data, generally by training the image capture device 30on the requested object and then initializing the capture process, byactuating a shutter in a still camera or actuating a record button in avideo recorder.

The prompts for pre-defined image data, for example, may be images of aparticular parcel of real estate or of a motor vehicle or of an animateobject like a human subject, which may be required in connection withreal estate transactions or insurance claims or legal actions. In videoimage recording applications, the pre-defined requests may be moresophisticated since dynamic image data may be stored in each video datafile.

The prompt may also request the operator to input audio and/or textualdata that identifies an image to be captured prior to capture. Accordingto this mode of operation, the image data to be captured is notidentified until the operator identifies the image data through atextual or audio input on the device in response to the prompt. Theprompt may also query the operator to input audio and/or textual data,for example descriptive information about an image captured or an imageto be captured. The audio and/or textual data, for example, may beinformation about the object or person that is not capturable as imagedata. The KODAK DC260 camera and other portable image capture deviceshave audio and keypad inputs for capturing these additional types datainput. The audio and textual data files are stored generally in userdefinable attribute storage portions of the corresponding image datafiles generated for the image data captured, or in corresponding datafiles, which may be related to corresponding image files.

In another embodiment of the invention, the attribute program segment ofthe device program provides a data processing attribute related to eachprompt, and the association program segment associates the dataprocessing attribute related to the prompt with the image file generatedfor image data captured in response to the prompt. The association ofthe data processing attribute related to the prompt is performed by thedevice program automatically and without input by the user. Theoperator, however, may select one more other data processing attributesfor association with the image file either before or after imagecapture, as discussed above in connection with FIGS. 2 a and 2 b.

In FIGS. 7 a and 7 b, a prompt for the capture of pre-defined image datais signalled, for example on a visual display of the device. In responseto the prompt, the device operator initializes image capture, asdiscussed above, whereupon an attribute related to the prompt isassociated with the image file by one of the means discussed above inconnection with FIGS. 3-5. According to this embodiment, the image filehas associated therewith an attribute related to the prompt in responseto which the image file was ultimately generated.

In the exemplary KODAK DC260 camera application, the device program isan executable DIGITA script file downloaded onto the removable flashmemory device thereof. In the KODAK DC260 camera, several differentDIGITA script files may be stored on the removable flash memory card ofthe camera. The scripts are executable by the device operator, forexample upon selection thereof from menus displayed visually on adisplay device of the device. In other portable image capture deviceapplications, the device program may be written or created in other fileor application programming languages.

The image files and the attributes associated therewith, including anyassociation files, are generally transferred from a data storage mediumof the portable image capture device 30 to the data processing system 20as discussed above, preferably by a removable data storage medium 35. Inthe exemplary KODAK DC260 application, image files are written to aremovable flash memory card on the camera, which may be used to transferdata to the data processing system 20. The KODAK DC260 camera alsoincludes data transfer software useable for other modes of transfer.

In FIG. 8, the device program is generated by a system computer programstored on a computer-readable medium and executable on a data processingsystem 20. The system program comprises generally a device programsegment that generates the device program, which is discussed above,based on user input defining for example data processing attributes andprompts. After generation, the device program is subsequentlytransferred to a portable image capture device by one of thecommunication means discussed above, where it is executable by thedevice 30. The system program may be a JAVA or C based program or otherprogramming language suitable for generating device programs.

According to another embodiment of the invention, the system programincludes an attribute data program segment that generates dataprocessing attribute data transferrable to a portable image capturedevice for use by a device program thereon. The system program may alsoinclude a prompt data program segment that generates prompt datatransferrable to a portable image capture device. In FIG. 8, thegeneration of the attribute and prompt data is generally performed onthe data processing system 20. The attribute and/or prompt data issubsequently transferred to a portable image capture device for use by adevice program residing thereon by any one of the means discussed aboveand illustrated in FIG. 1.

According to this aspect of the invention, a device program residing onthe portable image capture device may be provided with variableattribute and/or prompt data transferred from the data processing system20. It is not necessary to repeatedly download entire device programs tothe portable image capture device to change the attributes and promptdata used thereby. The attribute and prompt data may be changed bymerely transferring new attribute and/or prompt data from a dataprocessing system to the portable image capture device 30. Thisalternative reduces time and costs associated with generating new deviceprograms, and reduces the time required to transfer attribute and promptdata to the portable image capture device, which may be a significantsavings, particularly when wireless or serial communication means areemployed for the data transfer.

The system computer program, or system program, may also comprise anextraction program segment that extracts the data processing attributesassociated with each image file after the image files and attributesassociated therewith are transferred from the portable image capturedevice 30 to the data processing system 20. In one embodiment, theextraction program segment extracts the data processing attribute fromthe attribute storage portion of the image file, and in anotheralternative embodiment the extraction program segment extracts theattribute from a corresponding association file, or extracts image datafrom a document file. The extraction program segment may be an integralpart of the system program, or more generally may be a stand aloneprogram that operates separately from the system program.

The system computer program may also comprise a processing programsegment, also illustrated in the process flow diagram of FIG. 8, thatprocesses the image files generated for data captured by the portableimage capture device based on the data processing attribute associatedtherewith. The data processing attributes may be used to controlsorting, routing, storage and distribution of the image files. The dataprocessing attributes, for example, may be used to rename the imagefiles, or to populate application files or to populate data bases on adata processing system or network. The attributes may be used also topopulate document files on a data processing system or network, similarto the use thereof to populate document files residing on the portableimage capture device as discussed above. Additionally, data processingattributes may be used to facilitate other image file processing, asdiscussed generally above.

While the foregoing written description of the invention enables one ofordinary skill to make and use what is considered presently to be thebest mode thereof, those of ordinary skill will understand andappreciate the existence of variations, combinations, and equivalents ofthe specific exemplary embodiments herein. The invention is therefore tobe limited not by the exemplary embodiments herein, but by allembodiments within the scope and spirit of the appended claims.

1. A method of sending image data from a wireless device, comprising:generating an image file for image data captured by the wireless device;associating routing information with the image file, wherein the routinginformation is associated with the image file by writing the image fileand the routing information to a data file stored on the wirelessdevice; and sending the data file by wireless signal transmission. 2.The method of claim 1 further comprising: receiving audio informationrelating to the image data; and associating the audio information withthe image file by writing the audio information to the data file.
 3. Themethod of claim 1, wherein the image data includes a still image.
 4. Themethod of claim 1 wherein the image data includes motion video.
 5. Amethod associating data captured by a wireless device, comprising:capturing image data by use of the wireless device; generating an imagefile corresponding to captured image data; capturing audio data relatingto the image data; generating an audio file corresponding to capturedaudio data; and generating a data file associating the image file andthe audio file.
 6. The method of claim 5, wherein the captured imagedata includes a still image.
 7. The method of claim 5, wherein thecaptured image data includes motion video.
 8. A method associating datacaptured by a wireless device, comprising: capturing image data by useof the wireless device; generating an image file corresponding tocaptured image data; capturing text data relating to the image data;generating a text file corresponding to captured text data; andgenerating a data file associating the image file and the text file. 9.The method of claim 8, wherein the captured image data includes a stillimage.
 10. The method of claim 9, wherein the captured image dataincludes motion video.